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(54) Method and system for interpolation of digital signals 



(57) The invention relates to an interlaced to pro- 
gressive conversion method and system by use of an 
interpolation algorithm (IPC algorithm) which is scala- 
ble with several levels or modes with an increasing com- 
putational complexity depending on increasing 
availability of resources, i.e. computation power, availa- 
ble memory and available memory bandwidth. An IPC 
mode control can be implemented as a decision table. 
Peferably. at least five levels of the algorithm can be 
scaled beginning with line repetition (lowest level), lin- 
ear interpolation (lower level), median inter-field compu- 
tation with a three-tap or a five-tap median operator 
(medium level) and a combination of a linear interpola- 
tor and a median interpolator, eventually in combination 
with edge detection (higher levels of the scaleable algo- 
rithm). 



Integration of IPC into 
system wRh dynamic 



resource allocation 













-o- 






PCiytam 















JT 




in 
in 
o 

CD 

o> 

o 



1 



EP 0 946 055 A1 



2 



Description 

[0001 ] The invention relates to a method and a system 
for an adaptable scan raster conversion of an interlaced 
source signal into a progressive output signal by use of 
a signal interpolation algorithm (IPC algorithm). 
[0002] Interlaced to progressive conversion interpola- 
tion algorithms interpolate missing lines in an interlaced 
scanned source field In order to create a progressive 
frame. Interlaced scanning is a spatio-temporal sub- 
sampling scheme, i.e. vertical sub-sampling in the spa- 
tial dimension. This sampling raster combines the 
advantages of a high temporal sampling frequency, i.e. 
high field rate, with the advantages of a low spatial sam- 
pling rate with a moderate bandwidth or data rate. 
[0003] For progressive display media, e.g. computer 
monitors, LDC displays, etc., the problem is, to display 
an "interlaced signal" in a progressive fashion. Before 
this can be done, a formate conversion or scan raster 
conversion has to be performed, which transforms the 
signal from interlaced to progressive form (IPC). Since 
interlaced scanning is a spatio-temporal sub-sampling 
as mentioned, a spatio-temporal interpolation scheme 
has to be applied in order to achieve the best possible 
results. 

[0004] IPC algorithms can be coarsely divided into 
three algorithm classes. This classification is based on 
the most critical and characteristic source signal, i.e. 
image motion. The classes are: 

- static, i.e. no motion information whatsoever; 

- motion adaptive, i.e. a motion detector with some 
ON/OFF selection is required; 

motion compensated, i.e. it includes motion vector 
information. 

Static algorithms are basically motion-insensitive, i.e., 
time-invariant filter schemes and lack a distinct motion 
detector or motion vector estimator. Examples are: 

line repetition, 

linear line interpolation, i.e. one-, two- or three- 
dimensional FIR filters with a fixed spatio-temporal . 
filter aperture, and 

non-linear median filters, Le. one-, two- or three- 
dimensional filters. 

[0005] Due to the simplicity of these algorithm 
classes, the filters have a relatively simple implementa- 
tion, but their visual performance is potentially limited in 
comparison to motion adaptive or motion compensated 
algorithms. A good spatio-temperal behaviour of an IPC 
algorithm, according to the state of the art knowledge, is 
only achievable with a motion vector estimation. 
[0006] Motion adaptive algorithms feature a motion 
detector component, which performs soft- or hard- 
switching between mere spatial interpolation or a spa- 
tioftemporal interpolation, i.e. filter mask selection. The 



switching scheme includes thresholds and defined 
switching method. In other words, a motion signaling 
switches between spatial and spatio-temporal interpola- 
tion, i.e. the filter mask selection switching between ver- 

5 tical and temporal interpolation, and the motion signal is 
detected on a frame or field basis. A variety of motion 
detectors are proposed in the literature and reference is 
made to the literature list attached to this description. 
[0007] However, a motion detector estimation is a 

to computationally expensive task. 

[0008] It is an object of the invention to provide a new 
and improved method and system for a scan raster con- 
version of an interlaced source signal into a progressive 
output signal with good visual results but with low com- 

15 putational efforts. 

[0009] An implementation related problem is the avail- 
ability of system resources which can be used for the 
IPC algorithm. In a complex image processing system, 
which serves multiple purposes, resource availability Is 

20 often a time-variant function. This problem is 
approached with the invention by use of a scaleable IPC 
algorithm which - depending on the available resources 
at a certain time - yields the best possible interpolation 
result. 

25 [001 0] Based on this background from the above, the 
IPC problem is solved by the invention by an IPC algo- 
rithm wich converts an interlaced source signal into a 
progressive output signal with computational costs lim- 
ited to a minimum by use of only static but scaleable IPC 

30 algorithm depending on the time-variant availability of 
system resources. 

[0011] According to the invention, a method for an 
adaptable scan raster conversion of an interlaced 
source signal into a progressive output signal by use of 

35 a signal interpolation algorithm (IPC algorithm) is pro- 
posed which is scaleable in terms of various modes 
depending on the availability of the respective system 
resources and/or external constrains at a certain time. 
[001 2] Said system resources may comprise an alter- 

40 natively scaleable IPC system with respectively associ- 
ated alternative processing modules and/or module 
resources, respectively selectable depending on a 
grouped selection by an IPC mode control. Such sys- 
tem resources and/or external constrains may be com- 

45 putational power, available memory capacity, available 
memory bandwidth. Preferably, said interpolation algo- 
rithm in respect to each selectable mode is of a linear f fl- 
ter type and/or a median type and/or a combination of a 
linear interpolation, e.g. FIR filtering and a median fiiter- 

so ing. 

[001 3] A scan raster conversion system for converting 
an interlaced source signal into a progressive output 
signal by use of a signal interpolation algorithm (IPC 
algorithm) comprises according to the invention 

55 

various modules for signal interpolation, and 
an IPC mode control means provided with knowl- 
edge about required resources for specific classes 
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of interpolation processes and receiving input infor- 
mation about available resources of an embracing 
system at a certain time for supplying command 
structures for a mode specific selection of one or a 
combined plurality of said interpolation modules 5 
dependent on said input information. 

[001 4] According to a preferred embodiment, said var- 
ious modules for signal interpolation comprise at least 
one linear interpolator and a ranking filter interpolator. 10 
[0015] The various signal interpolation modules are 
based on the one hand on linear algorithms that can be 
divided into source signal insensitive algorithms, such 
as the above mentioned linear filters, and In non linear 
signal adaptive algorithms, such as t5 

median filters, 
weighted median filters, 

- vertical and/or diagonal edge adaptive interpola- 
tors, including edge adaptive median filters, and 20 

- filters that adapt to the spatial slope of lines. 

[001 6] This last mentioned third class is the most elab- 
orate interpolation scheme and offers the possibility of 
maintaining high spatial resolutions and thus a high vis- 25 
ual quality of the interpolation results, i.e. of the progres- 
sive frame with minimal aliasing with a variety of motion 
speeds. 

[001 7] An alternative class of algorithms, the motion 
compensated algorithms, features a variety of compo- 30 
nents, i.e.: 

motion vectors estimation on a frame or field basis, 

- motion vectors are computed for a variety of block 
sizes (spatial granularity) which can be as small as 35 
a single pixel, i.e. a motion vector for each source 
pixel, 

motion vector precision can vary and can be as 
detailed as on a subpixel basis, 
the interpolation scheme, which estimates the 40 
missing pixels in an interlaced source field incorpo- 
rates this motion vector information to enhance a 
visual quality of a resulting progressive image. 

[0018] A variety of motion estimators has been pro- 45 
posed such as 

block search, 

recursive block search/block matching, 

- phase correlation black matching, so 

- schemes to adapt MPEG motion vectors in order to 
use them for IPC. 

[001 9] The algorithm structure or architecture accord- 
ing to the invention is adaptive depending on the current 55 
resource setting or availability. This algorithm in its vari- 
ous modes belongs to the static interpolator type in con- 
sideration of implementation restrictions such as CPU 



power and memory. In its advanced mode, it is the mix- 
ture of a linear filtering, i.e. linear interpolation part, and 
edge adaptive median filtering, implemented in three- 
tap and f ive-tap median processor part. 
[0020] Whereas the sope of the present invention 
shall be determined by the terms of the claims to be 
interpreted by the description in consideration of the 
knowledge of the expert in this field, in the following var- . 
ious implementation examples of the invention are 
described with reference to the accompanying drawings 
in which 

Fig. 1 is an example for a look-up-table for an IPC 
mode control for adaptation of the algorithm 
mode in consideration of the available 
resources; 

Fig. 2 is a block scheme of a linear IPC interpola- 
tion module, e.g. a linear filter requiring a 
one-line-memory and a pixel averaging 
computation; 

Fig. 3 is a functional block scheme of a higher 
mode IPC module comprising a three-tap 
median predecessor operator, one field and 
two line memories; 

Fig. 4 depicts a functionality scheme of a higher 
mode IPC module comprising a three-tap 
median successor operator, one field and 
two line memories; 

Fig. 5 shows the functionality schemes of a higher 
mode five-tap median processor requiring 
two field memories, and three line memo- 
ries; 

Fig. 6 is an overall functionality block diagram of a 
resources oriented multimode IPC system 
integrated into an embracing system with 
dynamic resource allocation according to 
the invention; 

Fig. 7 is a pictural presentation of four different 
modes for vertical-temporal scan raster with 
respectively different IPC filter apertures; 

Fig. 8 is a field scheme showing line delays, filter 
apertures and field interpolation as well as 
IPC filter synchronization for three different 
modes of the IPC algorithm, i.e. for cases 
that an odd field comes in and for the cases 
that an even field comes in, respectively; 

Fig. 9 shows an implementation example for the 
basic version of a five-tap median algorithm; 
and 
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Fig. 1 0 depicts a modified implementation of a five- 
tap median algorithm using the output of a 
FIR interpolation. 



[0021] Referring first to the line delays for IPC filter 
synchronization as depicted in Fig. 8, an incoming 
source signal is scanned in the interlaced raster. The 
output is a progressive frame when the same original 
incoming source field is interleaved with interpolated 
lines to generate said progressive frame. 
[0022] Let's denote the incoming fields A, B, C, D, ... 
with A, C, ... being fields in the odd field raster position, 
and B, D, ... being in the even field raster position. The 
respective missing fields, i.e. fields which have to be 
interpolated are called A\ B\ C\ D' ... with A\ C\ ... 
being the respective even field raster positions, and B\ 
D', ... referring to the respective odd field raster posi- 
tions. A progressive frame is combined of interleaved 

fields (A + A*), (B* + B) (X + X'). or (X' + X). If as 

sometimes used the source fields are referred to as X 
and the interpolated fields are denominated by X'. 
The proposed IPC system according to the invention 
contains an algorithm which consists of two major com- 
ponents, i.e. 

- linear interpolation; this part will be referred to as 
"linear part", and 

- ranking order interpolation; this part will be referred 
to as "median part". 

[0023] In its basic form, a linear interpolation refers to 
a simple linear filter for averaging of two successive 
lines in a source field; four or more tap linear filters are 
possible. 

[0024] A ranking order filter interpolation in connection 
with the present invention refers to a median type filter 
having three-taps or five-taps. 
[0025] Even though not specifically emphasized addi- 
tional components could possibly be integrated in the 
multimode IPC algorithm, namely a bypass functionality 
in case an interlaced scanned signal is the targeted out- 
put. This mode (see first line of Fig. 1) could become a 
requirement for a flexible hardware solution. 
[0026] On the other hand, as a further sophistication 
of the IPC module including a five-tap median type filter 
(see Fig. 5 and line 5 in Fig. 1), edge detection and edge 
processing could be included in order to improve the 
performance of the five-tap median filter algorithm com- 
ponent on diagonal edges or variable slope lines (see 
line 6 in Fig. 1). 

[0027] Every level of the interpolation process 
requires a certain amount of "processing delay". This 
delay is defined as follows: It is the delay of incoming 
fields to the respective matching outgoing and interpo- 
lated fields. For example, if field B comes in and field A' 
(matching A) goes out, then the interpolator has a one 
field delay. This is important for the merging of source 
lines with the interpolated lines to generate a progres- 



sive frame. This is shown in principle in Fig. 6. 
[0028] If the algorithm has no field delay, the fields can 
be merged directly. But if the algorithm has a field delay, 
i.e. in the case of a three-tap and a five-tap median 
s operator, then the source field has to be delayed also for 
synchronization purposes. The appropriate delays can 
be seen in Fig. 2 to Fig. 7 in which the "center of filter 
operation" or the "center of gravity of the interpolator" is 
underlayed and framed by a shaded area in each case. 
70 [0029] As mentioned above, the new algorithm 
according to the invention is scaleable within several 
levels, here called "modes" with an increasing computa- 
tional complexity and increasing resource requirements. 
The level of interpolation depends on the available 
is resources which are not used by alternative processing 
modules. This is shown in the embracing system with 
dynamic resource allocation depicted in Fig. 6. The 
shown block "IPC mode control" can be implemented as 
a decision table for which a principle example device 
20 has a lookup table for IPC mode control as shown in Fig. 
1. Five different levels are shown in Fig. 1 with the 
respective hardware requirements for lines 2 to 5 shown 
in Fig. 2 to 5. 



25 1 . Lowest level: line repetition only; none of the two 
major parts is required (line 1 in Fig. 1). 
2. Lower level: only a linear part" is required; linear 
interpolation and intra-f ield computation (see line 2 
in Fig. 1 and Fig. 2). 

30 3. Medium level: only a "median part" is used. i.e. a 
three-tap median operator, a one field memory and 
inter-field computation in consideration of a prede- 
cessor field or a successor field, respectively (see 
lines 3 and 4 in Fig. 1 and Fig. 3 and Fig. 4). 

35 4. Higher level: combination of "linear part" and 
"median part"; five-tap median operator, two fields 
memories and inter-field computation (see line 5 in 
Fig. 1 and Fig. 5). 

5. Highest level: combination of "linear part" and 
40 "median part" as in level 4, however, additionally 
edge detection can be implemented to improve the 
filter performance on diagonal edges and variable 
slope lines (see line 6 in Fig. 1). 

45 [0030] For an overview of the respective filter aper- 
tures attention Is drawn to Fig. 7 in which for each of the 
four levels shown the respective center of gravity is 
underlayed and framed by a gray field. 
[0031] The various levels of the scaleable algorithm 

so according to the invention are explained in further 
details in the following. 

Add 1. Lowest level, i.e. line repetition (see Fig. 1, 
line 1): 

55 This is the lowest level of the IPC algorithm. 

Incoming source lines are simply repeated to 
make up the missing lines to generate a pro- 
gressive field. Either repetition of the upper 
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line or of the lower line is possible and can 
change from incoming field to field. No com- 
putation and no field memory are needed. 
The algorithm has no field delay; it repre- 
sents the lowest quality output and the low- 5 
est level, both in terms of output quality and 
in terms of required system resources. 

Add 2. Lower level, i.e. linear Interpolation, linear 

part" (Fig. 1 , line 2 and Fig. 2): 10 
This is the lower level of the IPC algorithm. 
No field memory but only some computa- 
tional performance is required. The algorithm 
has no field delay. A simple example of a lin- 
ear implementation is, that the missing pixel 15 
X' is computed by averaging the respective 
pixels above and below the missing X' pixel. 

Add 3. Medium level, i.e. a three-tap median inter- 
polation, the "median part" (see lines 3 and 4 20 
of Fig. 1 and Fig. 3 and Fig, 4): 
For this intermediate level of the IPC algo- 
rithm one field memory is required for the 
interpolation processing. There are two pos- 
sible ways to implement this algorithm called 25 
the "three-tap median predecessor" (see line 
3 in Rg. 1 and Fig. 3) and the "three-tap 
median successor" (see line 4 in Fig. 1 and 
Fig. 4). The predecessor type has no field 
delay, whereas the successor type has one 30 
field delay. This is the main difference 
between both implementations. The interpo- 
lation results are essentially the same, in 
terms of visual behaviour. The filter works 
such that three samples are taken from two 35 
successive fields, i.e. current and previous 
successive fields. The output is the median 
of: 

- The pixel (Picture Element) at position X' 40 
In the former/latter field X; 

- the pixel above the position X', 
the pixel below the position X*. 

[0032] It can be seen that pixels are taken from a ver- 45 
tical-temporal plane. That is the reason for a good edge 
preserving property in the vertical direction. 

Add 4. Higher level, i.e. five-tap median interpola- 
tion, i.e. the combination of the "linear part" so 
and the "median part" (see line 5 in Fig. 1 
and Fig. 5): 

In this higher level of the IPC algorithm, two 
field memories are required for the interpola- 
tion process. The algorithm has one field 55 
delay. Four samples are taken from three 
successive fields, the fifth sample is a spatio- 
temporal linear filter sample, If the field to be 



interpolated is denoted as lield B", the pred- 
ecessor is "field A" and the successor is 
"field C M . The output is the median of: 

pixel P at position X' from the predeces- 
sor field A. 

pixel S at position X' from the successor 
field C, 

pixel T on top of (above) position X* from 
the current field, 

pixel B of below position X' from current 
field B, and 

spatio-temporal linear filter sample. 

[0033] The linear sample can be computed in a simple 
way, such as averaging the pixels T and B. This equals 
the linear interpolation estimate in the linear part. 
[0034] Due to the vertical emphasis (3 out of 5 pixels) , 
a stronger weight is put on the spatial domain. A better 
motion rendition is achieved with less temporal artifacts. 
Also, a reduced emphasis is put onto spatial resolu- 
tions. 

[0035] For a generic implementation of five-tap 
median operators the readers attention is drawn to Fig. 
9 showing a basic version of a five-tap median algorithm 
as implemented according to the invention. Specifically 
for a two-tap average interpolator with a five-tap median 
interpolator please refer to the modified version of a 
five-tap median algorithm as shown in Fig. 10. 
[0036] The basic version of a five-tap median algo- 
rithm as exemplified in Fig. 9 results in the median out of 
five input values. As shown by respective functional 
equations, the idea is to sort out the maximum three 
times. The third maximum will be the median value. 
[0037] As to the modified version of the five-tap 
median algorithm shown in Fig. 10, again the median is 
generated on the basis of five values, however, different 
from Fig. 8, the knowledge about the linear part is used 
as one input value. In the specific example of Fig. 10 - 
which is not to be understood as a limitation for the lin- 
ear interpolation - the value which is built out of the top 
and the bottom value is between those and is the aver- 
age as shown by the "assumption". 

Add 5. Highest level, the combination of a five-tap 
median interpolation and edge detection 
(see line 6 in Fig. 1): 

In order to improve the median performance 
of the aforementioned higher level interpola- 
tion, a diagonal edge detector is additionally 
included. 

[0038] The main advantages of the invention over 
comparable State-of-the-Art IPC algorithms and IPC 
implementation structures are the following: 

a scaleable IPC structure is available in terms of 
system resources, i.e. CPU, memory requirements, 
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memory bandwidth, etc., by applying various dis- 
tinct IPC algorithms; 
• a simple IPC filter algorithm with small, local filter 
apertures is provided; 

- small resource requirements, compared to motion 
adaptive or motion compensated algorithms; 

- good performance, both on static image contents 
and also on moving objects; 

- an overall robust algorithm is provided for all image 
contents. 

[0039] The scaleable algorithm according to the inven- 
tion is configurable in hardware at the production time or 
as the case may be as a software configuration at sys- 
tem runtime. The multilevel scaleable algorithm of the 
invention provides a flexible adaptation for variable 
resource requirements or availability with the under- 
standing that more available resources provide for a 
better output quality. 

Prior Art Literature: 

[0040] 

Lit. [1] Gerard de Haan et al.; 
True-motion estimation with 3D recursive search block 
matching; IEEE Transactions on Circuits and Systems 
for Video Technology. October 1993 p. 368-379. 

Lit. [2] Oeistaemoe and Y. Neuvo; 
A Motion Insensitive Method for Scan Rate Conversion 
and Cross Error Cancelation; IEEE Transactions on 
Consumer Electronics, August 1991, p. 296-300. 

Lit. [3] Christian Hentschel: 

Bewegungsdetektion in Videosystemen mit Zeilens- 
prungabtastung; Rundfunktechnische Mitteilungen, 
Heft 4, 1994; 

Lit. [4] Gerard de Haan et al.; 
An Evolutionary Architecture for Motion-Compensated 
100 Hz Television; IEEE Transactions on Circuits and 
Systems for Video Technology, June 1995; p. 207-21 7. 

Lit. [5] US 5 483 288 



Claims 

1. A method for an adaptable scan raster conversion 
of an interlaced source signal into a progressive 
output signal by use of a signal interpolation algo- 
rithm (IPC algorithm) which is scaleable in terms of 
various modes depending on the availability of the 
respective system resources and/or external con- 
strains at a certain time. 

2. The method of claim 1, wherein said system 



resources comprise an alternatively scaleable IPC 
system with respectively associated alternative 
processing modules and module resources, 
respectively selectable depending on grouped 
5 selection by an IPC mode control. 

3. The method of claim 1, wherein said system 
resources comprise computation power, available 
memory and available memory bandwidth and/or 

1 o said external constraints comprise available system 
power. 

4. The method of claim 1 or claim 2, wherein said 
interpolation algorithm in respect to each selectable 

is mode is of a linear type and/or of a median type. 

5. The method of claim 4, wherein said interpolation 
algorithm in respect to each selectable mode is a 
combination of a linear interpolation filter and a 

20 median filter. 

6. The method of claim 5, wherein said adaptive 
median filter, depending on the respective! system 
resources, is performed by a three-tap median 

25 operator or a five-tap median operator, respectively. 

7. The method of claim 5 or claim 6, wherein a median 
filter specifically considering diagonal edges and/or 
variable slope lines is used for field interpolation. 

30 

8. The method of claim 1 or claim 2, wherein said IPC 
mode control is implemented by a decision table. 

9. The method of claim 4, wherein said interpolation 
35 algorithm is mode-selectable in steps of increasing 

complexity, of which 

- a first mode comprises mere line repetition, or 

- a second mode comprises only linear interpo- 
se lation, or 

a third mode comprises a three-tap median 
interpolation, or 

a fourth mode compirses a combination of a lin- 
ear interpolation and a five-tap median interpo- 
45 lation, or 

a fifth mode comprises a linear interpolation 
and a five-tap median interpolation with diago- 
nal edge and/or variable slope lines and/or var- 
iable slope lines detection and processing. 

so 

10. The method of claim 9. wherein intra-field FIR inter- 
polation is used as said linear interpolation. 

11. The method of claim 9, wherein said three-tap 
55 median interpolation is applied with one of two per- 
mutations of a predecessor or a successor field. 

12. The method of claim 9, wherein said second mode 



6 



11 



EP0 946 055 A1 



includes linear interpolation for a respective pixel X 
with an IPC filter aperture in consideration of a top 
pixel T and a bottom pixel B of the same field. 

13. The method of claim 9, wherein said third mode s 
includes three line median-interpolation for a 
respective pixel X with an IPC-f ilter aperture in con- 
sideraion of a predecessor pixel P or a successor 
pixel S, a top pixel T and a bottom pixel B. 

10 

14. The method of claim 9, wherein said fourth mode 
includes linear-inter-polation according to claim 12 
and five pixel values median interpolation of which 
one is the linearly interpolated X-value and the 
other four values are the predecessor field pixel P, is 
the successor field pixel S, the top pixel T and the 
bottom pixel B, respectively. 

1 5. The method of claim 1 4, wherein the median of said 
five values is formed according to the function: 20 

MEDIAN = Max {Min (W, X); Max (Y, Z)}, 
wherein 

W = Min {S; Max [P; Max (T, B)]}; 

X = Max {Min[P; Max (T B)]; FIR X}; 25 

Y = Min {Min [P; Max (T. B)]; FIR X}; 

2 = Min {T, B}. 

16. A scan raster conversion system for converting an 
interlaced source signal into a progressive output 30 
signal by use of signal interpolation algorithm (IPC 
algorithm) comprising 

- various modules for signal interpolation, and 

an IPC mode control means provided with 35 
knowledge about required resources for spe- 
cific classes of interpolation processes and 
receiving input information about available 
resources and external constraints of an 
embracing system at a certain time for supply- 40 
ing command structures for a mode specific 
selection of one or a combined plurality of said 
interpolation modules depending on said input 
information. 

45 

17. The system according to claim 16, wherein said 
various modules for signal interpolation comprise at 
least one linear interpolator and one ranking filter 
interpolator. 

so 

18. The system of claim 17, wherein said ranking filter 
interpolator ist a three-tap median interpolator. 

19. The system of claim 17, wherein said ranking filter 
interpolator is a five-tap median interpolator. ss 

20. The system of claim 1 7, wherein said linear interpo- 
lator is a FIR filter. 
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Function: 

MEDIAN (a, b, c, d, e) = 

MAX{ MIN[MIN(a,W);MAX(XY)l ; MAX[MIN(X;Y);Z] ) 

W = MAX{ b ; MAX[c;MAX(d;e)] } 

X = MIN{ b : MAX[c;MAX(d;e)l } 

Y = MAX{ MIN(c;MAX(d.e)] ; MIN(d;e) } 

Z = MIN{ MIN[c;MAX(d.e)] ; MIN(d;e)} 
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Assumption: 

FIR = 0.5 * (Top + Bot.) 
Function: 

MEDIAN = MAX( MIN(W,X) ; MAX(Y.Z) } 

W = MIN{ Succ. ; MAX[Piev.;MAX(Top. BoL)] ) 
X = MAX{ MIN[P; MAX(Top;Bot.)] ; FIR I 
Y = VGN( MIN[Prcv.;MAX(Top;Bot.)] ; FIR J 
Z * MINI Top; Bot ) 
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